Evolution of optimal Levy-flight strategies in human mental searches 
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Recent analysis of empirical data [F. Radicchi, A. Baronchelli & L.A.N. Amaral. PloS ONE 7, 
e029910 (2012)] showed that humans adopt Levy flight strategies when exploring the bid space in 
on-line auctions. A game theoretical model proved that the observed Levy exponents are nearly 
optimal, being close to the exponent value that guarantees the maximal economical return to players. 
Here, we rationalize these findings by adopting an evolutionary perspective. We show that a simple 
evolutionary process is able to account for the empirical measurements with the only assumption that 
the reproductive fitness of the players is proportional to their search ability. Contrarily to previous 
modeling, our approach describes the emergence of the observed exponent without resorting to any 
strong assumptions on the initial searching strategies. Our results generalize earlier research, and 
open novel questions in cognitive, behavioral and evolutionary sciences. 
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I. INTRODUCTION 

Levy nights are a special class of random walk whose step 
lengths follow a power-law tailed distribution [l|. They 
have been proved to be the most efficient type of space ex- 
ploration that can be adopted by a random searcher look- 
ing for scarce resources in an unknown environment Q. 
Probably for this reason, there are plenty of empirical 
evidences that movement patterns are compatible with 
Levy nights in many different contexts where efficiency 
matters In particular, Levy flights appear recur- 

rently in the description of the motion of animals in real 
space (see [l3| for a review). Animals explore the en- 
vironment mainly for searching food resources, and it 
is therefore plausible to ascribe the optimality of their 
search strategies to a selective evolutionary process. 

Recently, Radicchi et al. have provided empirical ev- 
idence that also human players participating in on- 
line auctions explore the bid space performing Levy 
flights [HI ■ The exploration of the bid space represents a 
search process, but purely mental because performed in 
an abstract space. Interestingly, players adopt nearly op- 
timal Levy flight exponents, in the sense that the values 
of the exponent used in real auctions are close to the one 
that maximizes their economic return. In (l5j , the search 
process in the bid space is studied as a game theoretical 
model, where the optimal exponent value corresponds to 
a Nash equilibrium . 

Here, we propose an evolutionary model in which the 
reproductive fitness of the individuals is proportional to 
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their ability to win the auctions, and we show that the 
values of the Levy flight exponents to which the model 
converges are very close to those measured in real data. 
This approach relaxes some of the assumptions made in 
the traditional game theoretical analysis, and deepens 
the understanding of the results: The optimality of the 
strategies adopted by bidders in on-line auctions can be 
seen as the outcome of a (evolutionary) learning process. 

The paper is organized as follows. In section II, we pro- 
vide a detailed description of the type of auctions studied 
and modeled in this paper. Section III is devoted to the 
description of the model and its analytical treatment. 
In particular, section IIIA describes the case in which all 
players can choose only a bid value, while, in section IIIB, 
we generalize the model to the case in which players can 
place an arbitrary number of bids. Section IIIC is dedi- 
cated to the evolutionary game theoretical implementa- 
tion of the model. Sections IV and V arc respectively 
devoted to the description of the numerical simulations 
of the model and to the estimation of the computational 
complexity needed to simulate or solve the model. In sec- 
tion VI, we provide a detailed description of the results 
of the model. Finally, in section VII, we draw our final 
comments and considerations. 



II. LOWEST UNIQUE BID AUCTIONS 

Lowest Unique Bid (LUB) auctions are a recent genera- 
tion of online games where the winners of the auctions 
may purchase expensive goods for strikingly small prices: 
cars, boats and even houses can be bought for only tens or 
hundreds of dollars (or euros, pounds, etc.). The mech- 
anism of the game is very simple. At the beginning of 
the auction, a good, whose typical market price is higher 
than a thousand dollars, is put up for auction. The game 
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duration is a priori fixed and generally two or three weeks 
long. A bid can be any amount (in cents) from one cent 
to a certain maximum value M, generally lower than one 
hundred dollars. For placing a bid, a player has to pay a 
fee, whose entity ranges from one to ten dollars depend- 
ing on the game. During the auction, players know only 
the status of their own bids meaning whether they are 
winning or not. None of the players knows where the 
others have placed their bids until the end of the game. 
Multiple bids on the same value from the same player are 
allowed, but do not influence the outcome of the auction 
since a bid is considered as unique when a unique player 
has bid that value even if more than once. When the 
time dedicated to the auction expires, the winner is the 
player who made the LUB and can finally purchase the 
good for the value of the winning bid. For example, if at 
the end of the auction bid value i = 1 is occupied by two 
bids (ni = 2), while n<i = 3, 713 = 1, ri4 = 2 and n.5 = 1 
are the number of bids placed on values i = 2, 3, 4 and 
5, respectively, then the winner is the player who has bid 
on value i = 3 because this is the lowest bid among all 
unique bid values. 

A similar mechanism is also used in Highest Unique Bid 
(HUB) auctions. In this type of the games, the rules are 
the same as those of LUB auctions, with the only differ- 
ence that the winning value is the unmatched bid closest 
to the maximal bid value admitted in the game (i.e., M). 
LUB and HUB auctions represent competitive arenas 
where players perform searches for a single target whose 
position is determined by the bids of the whole popu- 
lation. It is important to stress that, during the game, 
players are not aware of the values on which the other 
players have placed their bids, and therefore the explo- 
ration of the bid space of each player can be considered 
independent. Also, since the cost of each bid is much 
larger than the natural unit of the game (one cent), the 
number of steps that can be performed by a single player 
is limited and allows only a partial exploration of the bid 
space. Players need therefore good strategies in order 
to maximize their winning chances and simultaneously 
maintain limited their investments. 



1000 



800 



600 



400 



200 



10 



1 — I — 1 

10 t *o 



g10 

cl io~ J fe- 

10-4 

10~ E 



19 



10 



L 



10' 10' 

d 



10 



au-^A-A — a M..i 

50 100 'AS 

t 



150 



200 



Figure 1: (Color online) In the main panel, we plot dt the 
absolute value of the difference between the two consecutive 
bid vales b t +i and bt- t indicates the rank position of each 
bid in a ranking in which bids have been sorted accordingly 
to their time stamp. In the inset, we plot the pdf P (d) of 
the bid change amounts d (red circles). The pdf is fitted 
with a power-law function and the best estimate of the decay 
exponent is 1.5±0.1 (black dashed line). This figure refers to 
the exploration of the bid space performed by a single player 
in a single auction. A complete analysis of the movement 
patterns of hundreds of players was performed in our previous 
work [l5| . 



The empirical observation of Levy flights provided in [15| 
is by far the most significant evidence of this phenomenol- 
ogy in natural search processes. Differently from previ- 
ous studies regarding biological f^. 1^-461 [ToL [ill ] and mobil- 
ity 0, H| systems where "two orders of magnitude of scal- 
ing can represent a luxury" [l3j , the power-law decay can 
be clearly observed even over four orders of magnitude. 
The reason is that the space is not strictly physical and 
movements of tens of thousands cents can be performed 
at the same price of those one cent long: players explore 
the bid space in a effectively super-diffusive fashion, and 
steps are made at a virtually infinite velocity. 



In our previous work |15j . we have studied in detail 
the dynamical features of the bid space exploration per- 
formed by players in real LUB and HUB auctions. We 
have found that the exploration of the bid space is bursty: 
consecutive bid values are generally close to each other, 
but from time to time players perform longer jumps. In 
particular, the probability density function (pdf) P (d) 
of the bid change amount d (d is defined as the abso- 
lute value of the difference between two consecutive bid 
values) is consistent with a power-law P (d) ~ d~ a (sec 
Fig. [T]). The exploration of the bid space is therefore 
consistent with a discrete version of a Levy flight [Tij . 
More importantly, we have found that the pdf g (a) of 
the Levy flight exponents, adopted in real auctions, is 
peaked around the average value (a) ~ 1.4 and with 
standard deviation equal to a ~ 0.2. 



III. MODELING BIDDING STRATEGIES 

In this section, we provide an analytical model for LUB 
auctions, but the model can be easily extended also to 
HUB auctions. Supported by empirical evidence, in our 
model we assume that players explore the bid space per- 
forming Levy flights. In our previous work [To] ], we have 
provided a model based on stronger assumptions. In par- 
ticular, we have studied the winning chances of a player 
participating in an auction against a population of play- 
ers using exactly the same exponent value. Here dif- 
ferently, we do not make any assumption regarding the 
choice of the exponents. We let the exponents to be ran- 
dom variates extracted from a generic pdf, and study an 
evolutionary theoretical version of the game. Indcpen- 
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dently of the initial pdf, the pdf of the adopted expo- 
nents naturally evolves to a stable distribution centered 
around a value remarkably close to the one of the expo- 
nents measured in real auctions. 



A. First bid 

We consider a population of TV players whose strategies 
a are randomly extracted from a pdf g (a). Without loss 
of generality, we assume that g (a) > if a £ (ai,a2), 
and g (a) = otherwise. During the game, each player 
can place bids only on integer values i £ [1,M]. Since, 
at the beginning of the game, none of the players knows 
on which values the others will bid, it is natural to think 
that a generic player, with strategy a, sits at the leftmost 
site of the lattice. From this initial positions, the player 
places a bid on value i with probability 



s (i, a) 



m (a) 



9 (a) 



(1) 



where m (a) = J^ i=1 i~ a is the proper normalization 
constant. The probability that a generic player bids on 
value i can be calculated by simply integrating Eq. (TTJ) 



p{i) 



da s (i, a) 



(2) 



After all players have bid, there will be bids on the 
k-th bid value. The probability to observe a particular 
configuration {n} = (ni, ri2, ■ ■ ■ , rife, . . . , Um) is simply 
given by the multinomial distribution 



M 



P(W)=TV! ] 



fe=i 



(3) 



whose weights given by Eq. ([2]) and obeying the con- 
straint TV = rife. In particular, the probability that 
only one bid has been made on value i (i.e., the bid on 
value i is unique) is 



u(i) 



£ P({n}) = Np( i )[l-p^] N - 1 . 

(4) 

The probability that the bid on value i is the unique 
and lowest bid can be exactly calculated by summing the 
probability of Eq. ([3]) over all configurations {n} which 
satisfy this constraint (i.e., = 1 and rij ^ 1 for all 
j < i). Unfortunately, such enumeration cannot be easily 
computed. A good approximation, valid for sufficiently 
low values of p (i) and u (i), is to consider the uniqueness 
of the i-ih bid value as independent of the uniqueness of 
the other bid values and write 



_ f u{i) 



«w n fc <, [i-«(*o] 



if i = 1 
otherwise 



(5) 



as the probability that the bid on value i is the lowest bid 
among all the unique bids. The r.h.s. of Eq. ^ is the 
product of two terms: u (i) is the probability that only 
one bid has been made on bid value i; rifc<i [1 ~ u CO] ^ s 
the probability that none of the bid values smaller than 
i are occupied by a single bid (if i = 1 this probability 
is automatically equal to one since i = 1 is the minimal 
bid amount allowed) . Finally, the probability w (a) that 
the Levy flight exponent a is the winning strategy in the 
game can be inferred with 



w (a) 



M 

E 

i=l 



v(a\i) I (i) 



M 

E 



s (i, a) I (i) 
p(i) 



(G) 



v(a\i) = s(i,a) /p(i) is the conditional probability to 
observe a given i. This quantity is then convoluted over 
all bid values i, where the weight of each bid value is given 
by the probability that i is the winning bid value, that is 
Notice that Eqs. (HJ), © and ^ explicitly depend 
on the number of players N and the upper bid value M. 
We have suppressed both variables in the notation only 
for clarity and shortness. 



B. Multiple bids 

The same theoretical approach can be applied for the 
determination of the best strategy in a game where ev- 
ery player may perform multiple bids. We consider the 
simplest case in which each player bids T times, but the 
theory may be simply extended also to the case in which 
the number of bids of each player is extracted from an 
arbitrary pdf. 

In order to solve this game, we need to calculate st (i) 
which stands for the probability that, in T bids, a generic 
player has placed a bid on value i. If a is the player's 
strategy, the player will place the first bid on value i 
with probability q\{i\a) = i~ a /m(a). For the subse- 
quent bids, we need to define a transition matrix Q a . 
The generic element {Qa)^ represents the probability to 
place a bid on value i when the previous bid was placed 
on value j. In our model, we have 



rrij (a) 



(7) 



for all i and j in the interval [l,TVf]. The normalization 

Q ensures the proper def- 



constant rrij (a) = YliLi 
inition of the transition matrix. The matrix Q a describes 
a random walker which follows uncorrclated Levy flights 
with exponent a. At a generic step t, the probability 
that the player with strategy a sits on value i is 



■3 



It (i \a) 



M 

E 

3=1 



{Qa)ji qt-i U \a) 



(8) 
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The probability that this player placed a bid, in T bids, 
on value i is then 



the generation. At the beginning, we set e 
follow the scheme: 



1. Then we 



s T (i\a) = 1- [ [l-q t (i\a)} 



(9) 



t=i 



The term 1 — q t (i\a) counts the probability that the 
player has not placed a bid on value i at stage t. The 
probability that the player has not bid on value i at any 
stage is therefore the product of this single step probabil- 
ities. Finally, the probability that the player has placed 
a bid on value i at least once is calculated as the proba- 
bility to have bid on value i an arbitrary number of times 
minus the probability to have never bid on value i. No- 
tice that the model assumes that players have no memory 
because they are allowed to bid on the same value more 
than once. This is, however, unlikely to happen in the 
Levy and ballistic regimes (i.e., a < 3). Also, as in the 
case of real auctions, if the same player bids more than 
once on the same value this fact does not invalidate the 
uniqueness of the bid which is still considered as unique 
unless another player places a bid on that value. 
The probability that a generic player, performing T total 
bids, has placed a bid on value i is then 



l'UL2 

Pt{i)= / da s T (i \a) g (a) 



and can be used in place of the one appearing in Eq. (J2j) in 
order to calculate the remaining quantities ut (i), It (i) 
and wt (a) by using Eqs. © and (JB]), respectively. 



C. Evolutionary Model 

In order to understand how an optimal strategy can be- 
come shared across individuals, it is natural to adopt an 
evolutionary framework [l9j . In this respect, our model 
can be implemented in terms of competing individuals 
that are selected on the basis of their success in the 
searching process. In the spirit of the fundamental Moran 
process |2(|, at the end of each game, the winner of the 
auction generates an offspring to which transmits her/his 
search exponent a. The new individual enters the popu- 
lation endowed with an exponent a + £ (with £ random 
mutation), while a randomly extracted individual is re- 
moved in order to maintain the population size constant. 
Basically, the pdf of the winning exponents of the for- 
mer generation corresponds to the fitness function of the 
evolutionary model. 



1. Absence of mutations 

Let us first consider the case in which losers copy the 
strategy of the winners without errors. Imagine to have 
N players at each generation. They play the game by 
performing T bids each. Denote with e the number of 



1. Players randomly pick strategies a from the pdf 

9 {e) (a); 

2. They play the game. The result is the pdf (a), 
which quantifies the probability that a was a win- 
ning strategy; 



3. Set g 



(e+l) 



(a) 



,0) 



(a), increment e — > e + l, and 



go back to point 1. 



The former procedure describes the evolution of a 
population of players under repeated games. Setting 
g(e+l) ( a ) — W W ( a ) ensures that the players of the new 
generation have the tendency to pick winning strategies 
instead of losing ones. This can be better understood by 
writing the master equation 



9 



(e+l 

,0) 



} (a)-3 (e) (a) 



u4 e) (a) [1 - (a)] - 1 - ?4 e) (a) g^ (a) 



(11) 



from which one can easily obtain g 



(a) 



w. 



(e) 



(a). 



Eq. (fTT|) tells us that the variation in the population of 
players with exponent a increases as the probability that 

(10) 

a player with strategy a wins [w^r (a)] times the proba- 
bility to have other players with strategies different from 
a [1 — g^ (a)], and decreases as the probability that a 
player with strategy different from a wins [1 — wip (a)] 



times the probability to find a player with strategy equal 
to a [g^ (a)}. In other words, the probability of re- 
production of a player is proportional to the ability of 
player to win the game. The evolution rules resemble a 
Moran process where selection is made according to a fit- 
ness function here defined as the probability to win the 
game [20j ] . 



2. Random mutations 

A more natural assumption is to formulate a model 
where, each time a losing player changes strategy, she/he 
copies the exponent of the winner plus some random vari- 
ation. Assume that the variation £ is randomly extracted 
from a pdf y(£,a,/x), explicitly dependent on a and a 
set of parameters fl. The master equation describing the 
evolution becomes 
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( e+1 > (a) -g^ (a) 



4 e) (/3) [1-g^ 08)] 



-w^ia) ffW(a) 



with 5 (x) = 1 if and only if x = 0, while S (x) =0 oth- 
erwise. The gain term stands for the probability that 
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Figure 2: (Color online) Probability density function of the 
winning strategy w (a) in the case in which players' strategies 
are randomly extracted from a uniform probability density 
function g (a) defined over the interval (0, 5). We set N = 100 
and M = 100 (p arameter values similar to those observed in 
real auctions [IjJ]), and consider for simplicity only the case of 
a single bid T = 1 and the case in which all players perform 
T = 10 bids. We show in both cases the comparison between 
the results obtained with numerical simulations (T = 1 filled 
black circles, T — 10 empty black squares) and those obtained 
with the numerical integrations of the various equations [T = 
1 full (lower) line, T = 10 dashed (upper) line]. Note that 
the optimal value of a depends on T and also the parameters 
values N and M. However, this is a weak dependence and 
the peak value of probability density function of the winning 
strategy is in the range 1.2 to 1.7 for a wide range of possible 
values of N and M and a moderately broad range of values 
of T. 



IV. NUMERICAL SIMULATIONS 

The former analytical formulation of the model does not 
allow to obtain explicit expressions regarding the distri- 
butions of the winning strategies. The various equations 
can, in fact, be only numerically integrated to provide a 
solution of the model. Moreover, some of the equations 
contain approximations, and it is therefore worth ask- 
ing whether the solutions obtained with the numerical 
integration of the equations are compatible with those 
obtained by directly simulating the model. 
Simulating our model is straightforward. In each simu- 
lation, we use the following scheme: 

1 . Extract the exponent values of each of the N play- 
ers from the given pdf g (a) ; 

2. Simulate the game: for each of the N players, ex- 
tract T integer bid values from the corresponding 
power-law distribution, and determine the winner 
of the auction (the player who made the LUB) on 
the basis of these extractions. 

In the case of the evolutionary game model, at the end 
of the game we need to change the exponent value of 
one of the losing players, by copying (with or without 
random mutations) the strategy of the winner. We then 
repeat the game. A generation corresponds to N expo- 
nent changes. The pdf of the winning strategies of each 
generation is computed by repeating the entire procedure 
many times. 

V. COMPUTATIONAL COMPLEXITY 



the generic exponent /3 represents the winning strategy 
[wp (/?)] times the probability to have other players with 
exponent different from /? [1 — (/?)]. This term is then 
convoluted with the noise over all possible values of j3: 
this quantifies the probability that a random mutation 
changes the exponent from (3 to a [S (a — /3 + £)]. The 
loss term is simply the probability that a is not the win- 



ning strategy [1 



,( e ) 



(a)] and therefore players with 



exponent a moves away from it at rate g^ e ' (a). The 
delta function imposes the condition a — (3 + £ = and 
the former equation reduces to 



(a) 



+w { t> (a) 5 ( £ ) (a) 



■fd/3y(0 



a,P,p) w { T e) (f3) [1-g^ (/3)] 



(12) 



The pdf of the adopted strategies converges to stability 
whenever exists e for which g*- 6-1 " 1 ' (a) = g^ (a), which 
automatically implies that (a) — w^) (a). 



One could argue why use a complicated and approxi- 
mated set of equations instead of simple and straightfor- 
ward numerical simulations. The reason is that the com- 
putational time required for the numerical integration of 
the model's equations is much much lower than the one 
needed for obtaining good estimates with numerical sim- 
ulations. For clarity, we provide here an estimation of the 
computational complexity required in both approaches to 
the solution of the model. 

Consider first the case T = 1 (i.e., players make a single 
bid). In the case of numerical simulations with fixed val- 
ues of the exponents, the time required to simulate the 
game grows as M + TV log (M)G. M is the number of 
possible bid values and indicates also the computational 
time required to calculate the transition matrix from the 
starting position in the bid space (i.e., the origin of the 
lattice) to all M possible bid values. N is the number of 
players. The bid value on which each player places a bid 
can be calculated in a time that scales as log(M). Fi- 
nally G is the number of times that we need to simulate 
the same auction model in order to obtain a good esti- 
mation of the pdf w (a). The computational complexity 
of the numerical solutions of equations is M, since the 
computation of Eqs. |T]), (U]), (0 and ^) require a 
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Figure 3: (Color online) Probability distribution function (a) of the winning strategies at generation e. Here we set 



M = 1000, N = 100 and T ■■ 
2/i: we consider the cases /i 



1. The mutation £ is randomly extracted from a uniform distribution centered in zero and width 
0.0 (panels A and B, absence of mutation) and fi = 0.5 (panels C and D). In A and C, the starting 
distribution for the exponents is g' 1 ' (a) = 1/5 if a £ (0,5) and zero otherwise. Already after one generation (e = 1, lower 
black line), the peak of the distribution is around a ~ 1.5. As the number of generations increases, the distribution becomes 
more and even more peaked around a specific value of a, and reaches a stationary distribution. The asymptotic distribution 
has finite width for /i > 0, while is a delta function for fi = 0. As a term of comparison, we show also the results obtained 
with numerical after e = 20 generations (black circles). In B and D, we consider initial distributions for the exponents of the 
type g"' (a) ~ a~ A if a £ (0,5) and g^ 1 ' (a) = otherwise. We show the results for the three cases: A = (uniform, black 
full line), A = 2 (power-law, red dashed line) and A — 5 (exponential, blue dot-dashed line). The asymptotic distribution does 
not depend on the initial distribution and the peak value of the asymptotic probability density function does not depend on 
ft. Independently of the value of A, as the number of generations e increases, the average value (a) and the standard deviation 
a approach the same stationary values: (a) ~ 1.3 for any \x, while a = (as 1/s/e, thin black line in panel B) for /j, = 0.0 and 
a ~ 0.4 for fi = 0.5. 



computational time that grows as M. 
For general values of T, the computational complexity of 
numerical simulations is simply incremented by a factor 
T and grows therefore as T M +T N log (M) G. The time 
required for the numerical integration of the equation dif- 
ferently grows as T M 2 . The most computationally ex- 
pensive calculation is the one of Eq. © that requires 
a time growing as M 2 , and this computation has to be 
repeated T times. 



VI. RESULTS 



In all results, we consider the values N = 100 and 
M = 1000. The choice of these parameter values is jus- 
tified because they are of the same order of magnitude 
as those measured in real auctions [l5|. In Fig. [21 we 
plot the pdf w (a) for T = 1 and T = 10. In both cases, 
g (a) = 1/5 if a e (0,5), while g (a) = otherwise. 
Players randomly choose strategies that correspond to 
ballistic motion (a < 1), diffusive motion (a > 3) and 
super-diffusive motion or Levy flight (1 < a < 3). As- 
signing a flat initial distribution corresponds to assuming 
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Figure 4: (Color online) Same as figure [3] but with different parameter values. Here we set M = 1000, N = 100 and T — 10, 
and consider fi = 0.0 in panels A and B, while fj, = 0.5 in panels C and D. The asymptotic pdf of the winning strategies have 
average values (a) ~ 1.5 for any value of fi. The standard deviation is a = (as l/\/e) for n = 0.0, and a = 0.3 for fi = 0.5. 
For any value of n, the best strategy (i.e., the peak of the pdf) is placed at a* ~ 1.5. 



that players don't know which strategy is better for win- 
ning the game and all strategies are therefore a priori 
equivalent. It is interesting to see that already in this 
situation there is a clear advantage for players that per- 
form Levy flights and whose exponents are in the range 
1.2—1.5. It is also worth noting that the solutions ob- 
tained with the numerical integration of the equations 
are perfectly consistent with the results obtained with 
numerical simulations. 

More interesting is the case of evolutionary games. For 
simplicity, here we consider the case in which the distri- 
bution of the random mutations is a rectangular window 
of width 2fx: if o is the winning strategy, the new expo- 
nent is equal to a random number taken from the uniform 
distribution into the interval (a — /z, a + fx) . In the case 
in which the possible values of the exponents are bounded 
in the interval (01,0:2), we have to include the effect of 
the boundaries and write 



y (£,0,0:1,0:2, A*) = 




(13) 

where (,\ = min (o — ai,[i) and £2 = min (02 — a,fi). 



We show in Fig. [3] the results valid for T = 1 and in 
Fig. H] those obtained for T = 10. These figures show 
results that arc slightly different, but qualitatively iden- 
tical. The asymptotic pdf (o) of the winning strate- 
gies does not depend on the initial distribution (a). 
In absence of mutation, the limiting pdf is a delta func- 
tion centered around an optimal strategy a*. The con- 
vergence to such pdf is only asymptotic, since the width 
of the distribution goes to zero as 1/ y/e and is therefore 
finite at any finite generation e. If mutations are allowed 
(i.e., (J, > 0), (o) is reached after a finite number 

of iterations. The asymptotic distribution has a finite 
width. The number of iterations required to reach sta- 
bility depend on the initial pdf and the mutation rate /z, 
while its shape only on fi. In particular, the peak of the 
pdf is still at a* , the same value as the one measured in 
absence of mutations. The value of o* depends on the 
parameters of the model N, M and T but, for values con- 
sistent with those of real auctions (N = 50 to N = 200, 
M = 500 to M = 10000 and T = 1 to T = 100), a* 
ranges from 1.2 to 1.7. 
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VII. CONCLUSIONS 

A large wealth of empirical evidences suggest that ani- 
mals have a specific, and apparently innate, strategy to 
search an unknown physical environment [L3[. The dis- 
tances between two consecutive positions in the space are 
distributed according to a power-law probability density 
function. More interestingly, the exponent of the power- 
law distribution is close to the one that guarantees the 
most efficient search in an environment with scarce re- 
sources. Evolutionary considerations account for the high 
efficiency of the searching strategies of animals, since in 
a competitive environment only the fittest are able to 
survive and reproduce. 

A similar behavior has been observed also in how human 
players explore the bid space in on-line auctions [l5| . In 
this case, the environment is not physical but abstract. 
Nevertheless players adopt searching strategies for the 
winning bid value that are close to optimality: bid change 
amounts are power-law distributed, and the exponents of 
the power-laws are close to the value that can guarantee 
the highest winning chances. 

In this paper, we have provided a novel interpretation of 
this empirical evidence and used evolutionary considera- 
tions to explain the optimality of the observed exponents. 
We have introduced a Moran-like model in which the re- 
productive fitness of the players is proportional to their 
success in searches (20j . The player winning the auction 
reproduces, in the sense that the strategy of the winner 
is transmitted to another randomly extracted individual. 
We have considered both the cases of error-free repro- 
duction and of transmission with mutation. We have de- 



scribed the model analytically through a set of equations 
whose numerical solution is in excellent agreement with 
direct agent-based simulations. We have shown that the 
model is extremely robust with respect to the choice of 
the different parameters, producing results in good agree- 
ment with the ones observed in the empirical data. 



In summary, looking at activity patterns in the web [21 
our previous work [l5| suggested that humans and other 
animals share the same, apparently innate, strategy to 
search in an unknown, physical or mental, environment. 
Here we have shown that an evolutionary approach allows 
to account for the optimality of the observed exponents, 
in agreement with the view according to which the abil- 
ity to understand and be effective in the natural world 
is likely to be innate [22j] . This is the case for example 
of locomotion and perceptual- motor control [23j , hunting 
and foraging [24{ or nest building [25| . We have provided 
a new example with the remarkable novelty that it con- 
cerns a mental search process. While it is well known 
that humans share the intuition that numbers map into 
space [2{|, our work indicates that they might have de- 
veloped an innate knowledge about the best way to move 
in it. 
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